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Abstract 

A novel strategy to encrypt covert information (code) via unitary projections into 
the null spaces of ill-conditioned eigenstructures of multiple host statistical distribu- 
tions, inferred from incomplete constraints, is presented. The host pdf's are inferred 
using the maximum entropy principle. The projection of the covert information is 
dependent upon the pdf's of the host statistical distributions. The security of the 
encryption/decryption strategy is based on the extreme instability of the encoding 
process. A self-consistent procedure to derive keys for both symmetric and asym- 
metric cryptography is presented. The advantages of using a multiple pdf model to 
achieve encryption of covert information are briefly highlighted. Numerical simula- 
tions exemplify the efficacy of the model. 
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1 Introduction 



The success of prominent contemporary cryptosystems is attributed to the de- 
gree of difficulty in computing integer factorizations [1] and discrete logarithms 
[2, 3], respectively. This paper describes a novel strategy to encode covert in- 
formation via unitary projections into the null spaces of the eigenstructures of 
a hierarchy of host statistical distributions (multiple pdf's). The multiple pdf's 
are inferred from an incomplete set of constraints (physical observable's) using 
the maximum entropy (MaxEnt) principle [4]. Here, a multiple pdf model is 
defined as a hierarchial ensemble of pdf's p v \ v = 1, .... The index v is defined 
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as the hierarchy index. This paper defines the host pelfs p v to deviate from 
the equilibrium state, with increasing values of v. 

The case of incomplete constraints corresponds to scenarios where the num- 
ber of constraints (physical observable's) is less than the dimension of the 
distribution. In a discrete setting, the MaxEnt Lagrangian for a single host 
pdf p u (x n ) =p u n ,n = 1, N is [4]: 

N M N 

l me = -y: Pn Vn + EE M, (i) 

n=l i=0 n=l 



M < N , where the Lagrange multiplier (LM) \ U Q corresponds to the pdf 

N 

normalization condition J2 Pn = 1 • The LM's A^; i = 1,...,M correspond 

n=l 

N 

to physical constraints of the form J2 Pn®i{%n) — d\\i — 1,...,M . Here, 

n=l 

6, (x n ) ; i — 1, M is an operator, and, d\\i = 1, M are the incomplete 
constraints. This paper employs geometric moment constraints, i.e. 0j (x n ) = 
x l n ; i — 1, M . Solution of (1) yields: 



P n = ex P 
and, 



N 



M 

S \ x n 
i=0 



;n = l,...,N, 



(2) 



e A ° = £ e-^i = 1,...,M. 

n = l 



Solution of (2) for a given input set of LM's, is referred to as the forward 
MaxEnt problem. Inference of pdfs and the concomitant LM's, given an input 
set of d\\ % — 1, M, is referred to as the inverse MaxEnt problem. 

Statistical distributions inferred from incomplete constraints possess eigen- 
structures that are ill-conditioned. These demonstrate extreme sensitivity to 
perturbations. This sensitivity is exploited to formulate a principled framework 
to encrypt /decrypt code 1 . The null spaces of these eigenstructures constitute 
an "invisible reservoir" into which covert information may be projected. The 
projection is achieved without altering the host statistical distributions. The 
advantage of statistical encryption is that the dimension of the code that can 
be encrypted increases with the size of the statistical distribution. The projec- 
tion of code into a host statistical distribution is also a promising candidate 
to implement steganography [5], and, related disciplines in information hiding 
[6]. 



In this paper, the terms code and covert information are used interchangeably. 
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A recent study has treated the statistical encryption/decryption of covert 
information, using the Fisher information as the measure of uncertainty [7]. 
Qualitative distinctions vis-a-vis an equivalent MaxEnt formulation [8] have 
been established. The encoding strategies in [7] and [8] are independent of 
the pdf of the host statistical distribution. Encoding covert information into 
multiple pe?/'s allows code of dimension greater than that of any single host 
pdf to be selectively encrypted into the multiple pdf's. An example of this 
is the encryption of mult i- dimensional code defined in matrix form, such as 
image data. In this case, each dimension of the code (column/row vector of the 
matrix) may be selectively encoded into individual components (single host 
pdfs) of a multiple host pdf model. Each single host pdf is taken to be one 
dimensional in the continuum. 

Conversely, the dimension of each host in a multiple pdf model may be chosen 
by the designer to be less than the dimension of the code. This is tantamount 
to effecting a tradeoff between the dimension of a single host pdf and, the 
number of hosts comprising a multiple pdf model. The success of employing 
multiple pdf's to enhance the security of the covert information, is critically 
contingent upon the encryption/ decryption strategy being dependent upon the 
pdf's of the statistical hosts. This feature permits the pdf dependent statistical 
encryption/decryption strategy to possess immense qualitative flexibility, as 
compared with pdf independent models [7, 8]. Numerical simulations demon- 
strate impressive quantitative performance in securing covert information. 



2 Projection of the Covert Information 



Consider M constraints a\, d v M . In a discrete setting, these are expectation 
values of a random variable x i>n ] n = 1, N : 

N 

= J2Pn x i,n,i = ^,-,M. (3) 

n=l 



Evoking the Dirac bra-ket notation [9], the pdf \p v ) G di N which is a col- 
umn vector (ket), where \n) ; n — 1, N is the standard basis in $i N , is 

N N 

expressed as \p u ) = 12 \n) (n \ P u ) = 12 Pn \ n ) ■ Defining the column vector 

n=l n=l 

of observable's as \d v ) G 9ft M+1 with components d", ...,d v M) 1 , and, an op- 

N 

erator A : $l N — > 3? M+1 given by A = \ x n) ( n \ ■ Defining vectors \x n ) G 

71=1 

M+l M+l 

sjjM+i. n _ j\[ as the expansion \x n ) = \i) {i I x n) — 12 x in\i) , 

i=l i=l 
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where i is a basis vector in 9? M+1 , (3) may be expressed simply as: 

\d u ) = A\p u );A:$l N ^ft M+1 . (4) 

The physical significance of the constraint operator A in (4) is as follows. 
Inference of the pdf from physical observable's employing (2) is achieved by 
specifying Q i (x n ) = x l n . Setting, x l n — > x i>n ;i = l,...,M;n = 1,...,N , the 
Xi tn constitute the elements of the M rows and N columns of the operator 
A". The unity element in \d v ) G K M+1 enforces the normalization of \p v ). 
Consequently, xm+i,u — x n +1 — l',n= 1, N. 

The operator A is independent of the host pdf. This qualitative deficiency 
may be rectified by defining: 

A v = A + k u \d u )(I\. (5) 

Here, (I\ is a lxN row vector (bra), and, k u ^ —I is a constant parameter 
introduced to adjust the condition number of A v , and hence its sensitivity 
to perturbations. In (5), dependence upon the host pdf is "injected" into the 
operator A v by the incorporation of \d v ) . Specifically, each element of the 

N 

ket \d v ) is defined by d\ = £ p v n x l n \ i = 1, M. 

n=l 

Re-defining (4) in terms of (5) yields: A v \p v ) = \d u ) + (k u \ d u ) (I\) v , where 
(•) v signifies the expectation evaluated at the hierarchy index v . Expanding 
(k u \d u ) (I\) v = k u \d u ) (I\ p u ) , and evoking the pdf normalization: (I\ p v ) = 
1 , yields: 

d v ) = (k v + 1) \d v ) = A v \p v ) -A V :^ N ^ 3? M+1 . (6) 



The operator A v is ill-conditioned and rectangular. Thus, (6) becomes: 

tf) = (A v )~ x \fr) + Y), (7) 

where, {^) ls the pseudo-inverse [10] of A u , and lies in range (A v> ) ■ 
All necessary data dependent information resides in {A u ^j d h 



The null space term in (7) is of particular importance since the code is encoded 
into it via unitary projections. Here, p u '^ G null {A u ^j is explicitly data 
independent 2 . However, it is critically dependent on the solution methodology 



2 In this paper, null () signifies the null space of an ill-conditioned operator, unless 
explicitly specified as being the MATLAB® routine to calculate the normalized 
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employed to solve (7). To define the unitary projections of the embedded code, 
the operator G v = A uJ< A u is introduced. Here, A v * is the conjugate transpose 
of A v . For real matrices, A v ^ = A , where A is the transpose of A" . 

It is legitimate to project the covert information into null {A v ^ instead of 
null (G u ) [7]. The "loss of information" caused by floating point errors could 
make the evaluation of null (G u ) prohibitively unstable for many applications. 
Specifically, this operation squares the condition number, resulting in the large 
singular values being increased and the small singular values decreased. This 
instability is used to the advantage of the designer to increase the security of 
the covert information. 

Assuming the availability of A v and \p u ), the normalized eigenvectors corre- 
sponding to the eigenvalues in the null space of G v having value zero {zero 
eigenvalues) is: \n^);n — 1, N — (M + 1). The \rf£) are hereafter referred to 
as the basis of null (G v ). The unitary decryption U u dec : $t N -> sfp-W+V 
and encryption operators U" nc : SR N ~( M + 1 ) _ > operators for each v are: 

N-M-l 

Ul c = E \n)Kl 

71=1 

and, (8) 

„ . N-M-l 

71=1 



respectively. Note that U% ec • U" nc = I , where / is the identity operator. 

Given a code \q u ) e SR Ar -( M + 1 ) to be encrypted in a host pdf having hierarchy 
index v , the TV — [M + 1) components are given by (n \ q u ) = q^;n = 
1, N — (M + 1) . The pdf of the embedded code is: 

N-M-l 

\P U C ) = ULcW) = E K)(n\<f)- (9) 
n=l 



The total pdf comprising the host pdf and the pdf of the code is: 

W) = V) + \Pc) ■ (io) 

Since \p v c ) G null (A U ^J , A u \p u c ) = . In the decryption stage, the recon- 
structed host pdfs: \Pr), are first obtained. The pdfs of the embedded code 
is recovered from: 

Kc) = p v ) - K) ■ (ii) 



basis of an ill-conditioned operator (eg. Section 3.1). 
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The encrypted code is recovered by the operation: 

N-M-l 

\€) = U*eMc)= E \n) (^nlPrc)- (12) 
n=l 



The above theory does not, by itself, constitute the strategy to encrypt /decrypt 
code. This is achieved in two manners, i.e, symmetric and asymmetric crypto- 
graphic strategies [11,12]. Before proceeding further, the concept of a key in 
the encryption of covert information is briefly explained. The distribution of 
keys is an issue of primary concern in cryptography and allied disciplines. A 
key may be a program, a number, or a string of numbers that enables the le- 
gitimate recipient of the message (decrypter) to access the covert information. 
In cryptography, a secret, shared, or private key is an encrypt ion/ decrypt ion 
key known only to the entities that exchange secret messages. 

In traditional secret key cryptography, a key would be shared by the commu- 
nicators so that each could encrypt and decrypt messages. The risk in this 
system is that if either party loses the key or it is stolen, the system is broken. 
Secret key cryptography is also susceptible to a number of malicious attacks, 
the most common being the plaintext attack [11,12]. By definition, a plain- 
text attack is one where the prior messages have intercepted and decrypted 
in order to decrypt other messages. A more recent alternative is to use a 
combination of public and private keys. In this system, a public key is used 
together with a secret key. The RSA protocol [1] is a prominent example of 
a public key infrastructure (PKI). A PKI often employs a key ring strategy. 
Specifically, one key is kept secret while the others are made public. PKI is 
the preferred approach on the Internet. The secret key system is sometimes 
known as symmetric cryptography and the public key system as asymmetric 
cryptography. 

In this model, an operator G v is formed by perturbing select elements of G v 
by 5G"j. In symmetric cryptography, only a single element of G u is per- 
turbed. The security of the code may be ensured by adopting an asymmetric 
cryptographic strategy. Here, more than one element of G v is perturbed. 
Each bG\j > S u , a threshold. The extreme sensitivity to perturbations of G u 
causes the eigenstructure of G u = G v + SG^j to substantially differ from that 
of G v ', This assertion is valid even for infinitesimal perturbations SG"j. To dis- 
tinguish operations involving the ill-conditioned operators G u , the following 
change of notation is effected in (9)-(12): \q u ) -> |<f -»• \%), \p u c ) -> \p u c ), 
\P V ) -> Ppert),\Prc) ~* \Prc) , and > \€) ~* \Qr) ■ The \Vn) are hereafter referred 



to as the basis of null (G U ^J . 



Determination of the threshold is a vital task in defining the cryptographic 
keys in this model. This is accomplished by the designer (encrypter) who per- 
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forms a simultaneous encryption/decryption without effecting perturbations 
to the operator G v . Specifically, using (2), the host pdfs are inferred by solv- 
ing an inverse MaxEnt problem. The code \q v ) having dimension N — (M + l) 
is formed. The designer implements (9)- (12) for each hierarchy index v. The 
threshold for the cryptographic key/keys is: 5 U = \\\q u ) — 



3 Implementation of the Encryption/Decryption Strategy 



The process of encryption occurs after the host pdfs have been inferred from 
incomplete constraints for multiple pdfs. This procedure is detailed in Sec- 
tion 4. The terminology in cryptography and allied disciplines refers to two 
communicating parties as Alice and Bob, and, an eavesdropper as Eve. In this 
study, the author performs the role of both Alice and Bob by implementing 
the encryption on an IBM RS-6000 workstation cluster and, the decryption 
on an IBM Thinkpad running MAT LAB® v 7.01. 

Herein, the implementation of the encryption/decryption strategy by effecting 
perturbations SG"j to the operator G v is described. The procedures are to 
be implemented for each hierarchy index v. This Section presents the imple- 
mentation of the encryption/decryption strategies in point form, for the sake 
of clarity and brevity. 



3. 1 Encryption 



(i.) The host pdf \p") is inferred from incomplete constraints by solving (2) 
as an inverse MaxEnt problem, (ii.) The constraint operators A v and G v are 
evaluated formed, for an a-priori specified value of the parameter k v , from 
(5). The operator G v is formed by perturbing one or more elements of G v by 
8G\j > 5", the cryptographic key/keys, (in.) The basis \fQ ;n — 1, N — 

(M + l) , are evaluated by operating on G" with the MATLAB® routine 
null (•) that employs SVD, or with an equivalent routine, (iv.) The code \q u ) 
is generated, and, is encoded into the null space of G v using (9). (v.) The total 
pdf pp ert ) is obtained using (10). 



3.2 Transmission 



The statistical encryption model provides two separate manners in which in- 
formation may be transferred from the encrypter to the decrypter, via a public 
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channel. The first mode is to transmit the constraint operators A v and the to- 
tal pelfs v v P ert]- A 11 alternate mode is to transmit the LM's obtained on solving 

the inverse MaxEnt problem(Section 3.1), and, the total pelfs V U pert)- Owing 

to the large dimensions of the constraint operators A v , the latter transmission 
strategy is more attractive. The values of parameters k u for each hierarchy in- 
dex, and, the cryptography key/keys are transmitted through a secure/covert 
channel. The key/keys are labeled in order to identify the elements of the op- 
erator G v that are perturbed. In the case of asymmetric cryptography, some 
of the keys may be declared public, while keeping the remainder private. 



3. 3 Decryption 



(vi.) The legitimate receiver recovers the key/keys 5G"j and the parameter 
k v from the covert channel, (vii.) The operators A , G v , and, G v are 
constructed, (viii.) The host pdf may be recovered in two distinct manners, 
depending upon the transmission strategy employed. Note that both methods 
to reconstruct the host pdf require the total pdf p v vert to be provided by the 
encrypter. First, the scaled incomplete constraints, defined in (6), are obtained 



by solving (i\ A 



Ppert ^ 



d v j . Here, i is a basis vector in 3? M+1 . This 

procedure is possible because \p v c ) G null (A 1 ^ . Thus, A v \p v c ) = . The host 
pdf are then computed for each hierarchy index by solving the inverse MaxEnt 
problem, using the re-scaled set of incomplete constraints. Alternatively, the 
host pdf may be obtained by solving (2) as a forward MaxEnt problem, given 
the values of the LM's ; i = 1,...,M obtained from the inverse MaxEnt 
problem (Section 3.1). Both methods allow the reconstructed host pdfs \p") 
to be obtained with a high degree of precision, (ix.) The reconstructed code 
pdf \pr C ) is recovered using (11). (x.) The reconstructed code \q") is obtained 
using (12). 

It is important to note that the success of the encryption/decryption strategy 
is critically dependent upon the exact compatibility of software available to 
the encrypter and decrypter. Of special importance is the compatibility of the 
routines to calculate the basis \ fj^). 



4 Numerical Simulations 



This Section provides numerical simulations to analyze the theory and im- 
plementation of the statistical encryption/decryption strategy, presented in 
Section's 2. and 3., respectively. To demonstrate the efficacy of the theory pre- 
sented in this paper, it is judicious to compare the pdf dependent model with 
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a pdf independent model [8]. These are characterized by the constraint oper- 
ators A v (described in (5) and (6)), and, A (described in (4)), respectively. 
The following numerical studies perform the encryption/decryption strategy 
for the case of asymmetric cryptography. Section 4.1 demonstrates the infer- 
ence of the host pdfs from incomplete constraints, using an inverse MaxEnt 
procedure. 



The comparative analysis between the pdf dependent model and the pdf in- 
dependent model is accomplished using two separate metrics, that define the 
security of the covert information. Host pdfs that deviate further from the 
equilibrium state often possess a constraint operator A having a higher con- 
dition number, as compared with pdf's that are closer to the equilibrium state. 
Increasing the condition number of the constraint operator A (or, A) repre- 
sents one way of securing the integrity of the covert information. The condi- 
tion numbers of the constraint operators are obtained using the MATLAB® 
routine cond{»). This provides a measure of the sensitivity of null (G) and 
null (G v ) to perturbations. 



In the pdf dependent model, the security of the code is enhanced by the 
increased sensitivity of null {G v ) to perturbations of select elements of the op- 
erator G u , resulting in the operator G" with null space denoted by null (G^. 
Within the framework of this model, a more relevant metric of the extreme 
sensitivity of null (G u ) to perturbations, brought about by the introduction of 
the cryptographic keys 5G"j, is the distortion of the code pdf \p u c )- Here, \p v c ) 
is evaluated from (9), using rf n (the basis of null {G u )). The distorted code pdf 
is IP"), which is calculated from (9) using rf n (the basis of null (<?")). Note 
that the codes \q") and \q u ) are identical kets. 



For the pdf dependent model, the RMS error of encryption between \p u c ) and 
\p») is defined as: RMS» enc = ^gfe - Here, \\en^J = ||(|#) - |#»|| , 

and, length (err" nc ) is the dimension of {\p u c ) — \p v c )). Section 4.3 will exemplify 
the utility of RMS v enc in resolving a dichotomy. Specifically, it will be demon- 
strated that a high value of RMS v enc is the reason for host pdf's possessing 
constraint operators with lower condition numbers, sometimes providing a 
greater degree of security to the encoded covert information, than host pdfs 
possessing constraint operators with higher condition numbers. 



Another measure of the security of the covert information, that is opera- 
tionally advantageous, is the RMS error of the difference between the en- 
crypted code, and, the code reconstructed without the cryptographic keys. For 
the pdf dependent model, the RMS error of reconstruction is: RMS v recon = 
^i!r g Ih(errl con y Here ' ll err ™ll = lid?") " \Qri))\\ , and, length {err v recon ) is 
the dimension of (\q v ) — \q"^j). 
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The rationale for evaluating the RMS^ econ is to obtain a measure of the error 
of reconstruction by an unauthorized eavesdropper (Eve), who does not possess 
the correct cryptographic keys SG"j. Eve is, however, assumed to be in pos- 
session of the reconstructed code pdf \p£ c ) . Such an attack may be simulated 
by choosing the wrong set of keys, and, incorrectly constructing the perturbed 
operators G v and G . Alternatively, an analogous scenario may be simulated 
by assuming that the reconstruction is performed without keys (sans keys). In 

N-M-l 

this case, the reconstructed code without keys is: jg^) = \n) (Vn I Pre)- 

71=1 

Here, nf n is the basis of null (G u ). Section 4.2 presents the comparative anal- 
ysis using the performance metrics described above. Analysis of the results is 
provided in Section 4.3. 



4-1 Inference of the host pdf's 



Host pdf column vectors (kets) corresponding to hierarchy indices v = 1 and 
v = 2, each of dimension 401, are independently inferred in the event space 
[—1,1] . The incomplete constraints are the first four moments of the random 
variable x n ; n — 1, N. From (2), one obtains: 

N=401 ,■ _\i' T 2 _\y-Z 

< = "^oi" : 4 i < = 1, -, M = 4 (13) 

y~* g ^i x n ^2 X n ^3 X n ^4 X n 

n=l 



Here, (13) is solved as an inverse MaxEnt problem for two different sets of 
incomplete constraints (corresponding to each hierarchy index), provided as 
input values. These are d» =1 = -0.0224,^ =1 = 0.1048,^ =1 = -0.0124,< =1 = 
0.0284, and, d\= 2 = 0.1,d%= 2 = 0.34%= 2 = 0.1,d u 4 = 2 = 0.15, respectively. Note 
that the values of d\ =1 , are taken to be the same as those in [8]. 

Each hierarchy index yields M + 1 constraint equations, that are solved using 
a Newton- Raphson procedure. Note that the (M + l) st constraint equation 
follows from the pdf normalization condition. The values of the LM's are found 
to be Ar 1 = -0.30435,Ar 1 = 2.99664,Ar 1 = 4.85637,< =1 = 3.81359 , 
and, A^ =2 = 1.74906,Ar 2 = -5.09475,Ar 2 = -4.8568, A^= 2 = 8.48337 , 
respectively. 

In this example, each constraint operator A u is of dimension 5 x 401 , and, 
the number of basis fj^ =1,2 is 396, for each hierarchy index. Figure 1 depicts 
the two host pdfs. The case with hierarchy index v — 1 is the single peaked 
pdf while the case with hierarchy index v = 2 is the double peaked pdf. 
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Fig. 1. Host pdf's inferred from incomplete constraints for v = 1 and v = 2 

4-2 Comparative analysis 

The MATLAB® random number generator rand (•) is evoked to generate 
code in [0,1] . In order to establish a degree of uniformity in the comparisons, 
two identical kets of the code, each having dimension iV— (M + 1) i.e. 396, are 
created for projection into the null spaces of the perturbed operators G v and 
G, respectively. This "emulates" the selective projection of a code comprising 
of a single ket of dimension 792, into null (G v=1,2 j and nullf&j, for each 
hierarchy index. 

A further measure of uniformity in the comparative analysis is sought by 
specifying the perturbations to both G and G v as BG\$ = SG 1 ^' 2 = 
3.0e — 013 (first row, third column) and 5(j2,7 = SG^ 1 ' 2 = 7.0e — 013 
(second row, seventh column), respectively. All numerical examples in this 
paper have a threshold for perturbations 5 U ~ 4.4e — 014 . 

Simulations for the case of the pdf independent model are described in Section 
4.2.1. Two distinct case studies for the pdf dependent model are described in 
Sections 4.2.2 and 4.2.3, respectively. The results are presented in Table 1 
through Table 3. Therein, sample values of the original code, the code re- 
constructed with the keys, and, the code reconstructed without the keys are 
presented. These comprise the l si , 75 th , 177 th , 296 th , and, 395 th elements of 
the respective arrays (kets). As is evident from the numerical simulations, the 
reconstructed code with the keys is exactly similar to the original code. The 
corresponding RMS^ econ is zero. On the other hand, the code reconstructed 
without the keys bears no resemblance to the original code. 
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Table 1 

Select code values for the pdf independent model. \q v ) - the original code,|g^) - the 
code reconstructed with the keys, and, \q^) - the code reconstructed without the 
keys. 



u=l,2 



) 



v=l,2 

q r 



v=l,2 
Qrl 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



-0.09239755885631 
0.20008072567388 
-0.16469110441464 
0.92507582836680 
-0.51825561367528 



Table 2 

Select code values for the pdf dependent model-case study 1. \q v ) - the original 
code,|<^) - the code reconstructed with the keys, and, - the code reconstructed 
without the keys. 



~u=l,2 



> 



~v=l,2 

q r 



T 1 ) 



It 



Qrl / 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



-0.08237185729405 
-0.01133471359936 
-0.33080751552396 
-1.18947579992697 
0.54528163427934 



0.40428740297403 
0.30190786147110 
-0.29261640748833 
0.53834101226185 
-0.10688384159491 



4-2.1 Pdf independent model 

Here, cond (A) = 18.80458 , RMS y =^ 2 = 0.76998, and, RMS V =^ = 0.77483 . 
The values of the encrypted and reconstructed codes are independent of the 
hierarchy index. These results are consistent with expectations since the nature 
of the host pdf is not reflected in the constraint operator A. Select code values 
are presented in Table 1. 



4-2.2 Pdf dependent model : case study 1 

The parameters are k u=1 = 0.065, and, k u=2 = 0.09. Here, cond (i^ =1 ) = 
19.87136, RMS U =^ = 0.79533, and, RMS v =} on = 0.80034. Further, cond (^= 2 ) 
= 20.42975, RMS^= 2 = 0.82570, and, RMS v = 2 n = 0.83090. This case repre- 
sents a noticeable increase in the level of security of the code, and flexibility of 
the theory, as compared with the pdf independent model. Select code values 
are presented in Table 2. 
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Table 3 

Select code values for the pdf dependent model-case study 2. \q u ) - the original 
code,|(^) " the code reconstructed with the keys, and, \q~ri) - the code reconstructed 
without the keys. 



u=l,2 



> 



~i/=l,2 

q r 



Qrl I 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



0.23813682639005 
0.69913526160795 
0.27379424177629 
0.17686701421432 
0.20288628732009 



0.41205157405440 
0.96359310993344 
-0.03625400789579 
-0.94767053576282 
-0.87540038881240 



-1.47600706971518 
-0.12406066610739 
0.71289692833557 
-0.37638356088402 
0.57110616844674 



4-2.3 Pdf dependent model -.case study 2 - a study in contrast 



The parameters are k v ~ x 
18.31597, KM SI 



enc 



-0.03, and, k u=2 = -0.5. Here, cond (> =1 ' 

0.82134. Further, cond (A u=2 ) 



0.81620 and, RMS v =^ on 



= 11.97782, RMS V = 2 = 0.84434 , and, RMS v = 2 n = 0.84965. This case rep- 
resents a noticeable increase in the level of security of the code in terms of 
RMS^Zlni the RMS error of reconstruction, as compared with the results in 
Sections 4.2.1 and 4.2.2, respectively. Select code values are presented in Table 
3. 



4-3 Analysis of results 



The case presented in Section 4.2.2 follows expectations. Specifically, the con- 
straint operators A u=1,2 possess larger condition numbers than the constraint 
operator A of the pdf independent model, presented in Section 4.2.1. Further, 
the RMS^' 2 and RMS^Jyn i n ^ ne pdf dependent model are greater those 
for the pdf independent model. This implies that the pdf dependent model 
provides greater security to the covert information, than the pdf independent 
model. The case presented in Section 4.2.3 represents an interesting scenario, 
which poses a dichotomy of sorts. 

Conventional logic would expect an increase in the condition numbers of 
A u=1,2 to coincide with an increase in the sensitivity of null (G u=1,2 ) , and 
thus, an increase in the values of RMS^l' 2 . Section 4.2.3 conclusively demon- 
strates the fact that the condition number of A" and the RMS v recon do not 
necessarily increase simultaneously. Specifically, the case presented in Section 
4.2.3 demonstrates a significant decrease in the condition numbers of A u=1,2 , 
that is accompanied by a significant increase in RMS^l' 2 . 

This dichotomy may be explained by the fact that an increase in the value 
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of RMS^ln i s always accompanied by a corresponding increase in the RMS 
error of encryption: RMS v e ^}' 2 . This trend is evident in each of the case stud- 
ies presented in this paper, and, has been consistently observed in numerous 
simulation exercises. As indicated in the introduction of Section 4, the RMS 
error of encryption (RMS" nc ) represents a more relevant metric to assess the 
sensitivity of null {G u ) to perturbations 5G"j, as compared to the condition 
number of A v , within the framework of this statistical encryption/decryption 
model. 

This Section is concluded by providing a glimpse of the effects of the instability 
of the eigenstructures of the ill-conditioned operators. Figure 2 depicts the 
error of encryption: \p v c ) - \p u ) for the case study presented in Section 4.2.3, 
corresponding to k u=2 = —0.5 The highly oscillatory ("chaotic") profile in 
Figure 2 is indicative of the extreme sensitivity of null (G v ) to perturbations 
5GIj applied to G u . 

It may be noted that the code \q u ), projected into each host pdf comprises 
of a ket of dimension 396 created by a random number generator. While one 
might expect the randomness inherent in \q u ) to be factored into the error 
of encryption, further investigation concerning the oscillatory behavior is re- 
quired. The ket \q v ) is subjected to a sorting operation, by employing the 
MATLAB® routine sort(»). This results in a ket \q u ) of dimension 396, 
containing progressively increasing values defined in [0, 1]. The resulting error 
of encryption using the sorted code is depicted in Figure 3. 

As is observed, the error of encryption still displays a highly pronounced os- 
cillatory behavior, despite the randomness in the code being mitigated. Akin 
to the case depicted in Figure 2, this oscillatory behavior is reflective of the 
instability induced in null (G u ) by perturbing 2 elements of G u (having di- 
mension 401 x 401) by 3.0e — 013 and 7.0e — 013, respectively. Figure 4 depicts 
the total pdf defined by (10), corresponding to the case study presented in 
Section 4.2.3 for v = 2. As is expected, the total pdf exhibits a highly oscil- 
latory (" chaotic" ) behavior. This is in stark contrast to the smooth curves of 
the host pdfs depicted in Figure I. 



5 Summary and Conclusions 

A novel strategy to project covert information into a hierarchy of statistical 
hosts has been presented. This has been accomplished within the ambit of the 
MaxEnt principle. The encryption/decryption strategy relates the projection 
of the covert information to the host pdfs. This feature permits the statistical 
encryption/decryption strategy to possess immense qualitative flexibility, and, 
provide enhanced security to the covert information, as compared to a pdf 
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-1 -0.8 -0.6 -0.4 -0.2 0.2 0.4 0.6 O.f 



Fig. 2. Plot of the error of encryption: \p£)- \p") 




-1 -0.8 -0.6 -0.4 -0.2 0.2 0.4 0.6 0.8 1 



Fig. 3. Plot of the error of encryption: \p")- \Pc) with sorted code, 
independent model [8]. 

The pdf dependent model, presented herein, sometimes demonstrates an in- 
creased RMS error of reconstruction for decreased values of the condition 
number of the constraint operator A u . This seemingly counter-intuitive result 
is adequately explained with the aid of the RMS error of encryption. The 
RMS error of encryption is demonstrated to be a viable and relevant metric 
to assess the sensitivity of null (G u ) to perturbations SG^j. 

The statistical encryption/decryption strategy is platform independent, and 



15 



_ 2 I 1 1 1 1 1 1 1 1 1 
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x 

Fig. 4. "Chaotic" nature of the total pdf = host pdf + code pdf 

the process of recovery of the covert information is accomplished with a very 
high degree of precision. The small amounts of data being transmitted through 
the covert channel as a consequence of the transmission of the cryptographic 
keys SG"j and the hierarchy indices k u, s (see Section 3.2), augers well for a 
coupling between the statistical encryption/decryption model, and a quantum 
key distribution protocol [13, 14]. 

A study extending the present work, by describing the statistical encryp- 
tion/decryption strategy within the framework of a Fisher-Schrodinger model, 
has been recently completed. Herein, the Fisher information has been em- 
ployed as the measure of uncertainty. The host pdfs satisfy a time indepen- 
dent Schrodinger-like equation (TISLE) with an empirical pseudo-potential, 
that approximates a time independent Schrodinger equation (TISE) physical 
potential [7, 15] . The TISLE inherits the energy states of the TISE, within 
an information theoretic context. The encryption of covert information is tan- 
tamount to projection of the code into different energy states of the TISLE. 
The hierarchy indices in the present paper are replaced by the TISLE energy 
states. 

The Fisher-Schrodinger model provides a quantum mechanical connotation to 
the statistical encryption/ decryption strategy. Coupling the Fisher-Schrodinger 
model with a quantum key distribution protocol holds forth the prospect of 
achieving a self-consistent hybrid statistical/quantum mechanical cryptosys- 
tem. This work will be shortly presented for publication. 

Ongoing work is directed towards a two-pronged objective. First, the pro- 
jection of the covert information into null (G u ) has been provided with an 
information theoretic basis. Next, models to extend the work presented in 
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this paper to the case of steganography and information hiding have been 
developed. 

By definition, steganography involves hiding data inside other (host) data. 
In steganography, the covert information is concealed in a manner such that 
no one apart from the intended recipient knows of the existence of the mes- 
sage. This is in contrast to cryptography, where the existence of the message 
is obvious, but the meaning is obscured. The extension of the statistical en- 
cryption/decryption model presented in this paper to steganography involves 
encrypting image data into a cover image. In this case, the average pixel inten- 
sities of the cover image constitute the incomplete constraints. These results 
will be presented in future publications. 
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